Web Survey Bibliography
In questionnaires that present fully-verbally-labeled rating scales visually to measure attitudes, response choices are usually shown in ascending or descending order from most positive or negative to least positive or negative. This research explores whether and how departures from this convention might affect respondent behavior. We manipulated the wording of answer choices and the order in which they were presented, and measured answer choices, time to complete the questionnaire, and respondent satisfaction with the survey experience.
Respondents in a large national survey were randomly assigned to one of three experimental conditions: the standard order (SO), moderately unsystematic order (MUO), and random order (RO) conditions. In the SO condition, rating scale response options were presented in a conventional order from most positive to most negative. In the MUO condition, the response options appeared in that same order except for the reversal of the ordering of the two response options at either the beginning or the end of each scale. In the RO condition, the same response options appeared, but in random orders. If respondents rely only on the denotative meanings of words in the response options, then the frequency with which people chose each option should not vary depending on presentation order. But if people quickly perceive each rating scale as representing a continuum, respondents in the MUO condition may ignore the small denotative meaning differences between the reversed adjacent scale point labels and place themselves along the continuum at the same places as they would have in the SO condition. And if people pay at least some attention to the denotative meanings of the verbal labels, then they should quickly detect the random order and choose the labels in the RO condition with the same frequency as they do in the SO condition, ignoring the order of presentation.
Homepage (Abstract)
Web survey bibliography (4086)
- The case for publishing (some) online polls; 2007; Taylor, H.
- Surveys interviews and new communication technologies; 2007; Schober, M. F., Conrad, F. G.
- Spoken and multimodal dialog systems for survey research; 2007; Johnston, M.
- Sampling in online surveys; 2007; Beidernikl, G., Kerschbaumer, A.
- Sampling for web surveys; 2007; Rivers, D.
- Response option ordering: Reconciliating meanings conveyed by rating scale position and label. Unpublished...; 2007; Garland, P., Krosnick, J. A.
- Research synthesis: The practice of cognitive interviewing; 2007; Beatty, P. C., Willis, G. B.
- Reinterview: A tool for survey quality improvement; 2007; Feindt, P., Schreiner, I., Bushery, J.
- Reconstructing childhood health histories using internet panels; 2007; Smith, J. P.
- Qualitative data exchange: Methods and tools; 2007; Corti, L.
- Pilot study to recruite a sample for an online panel: Effects of contact mode, incentives and information...; 2007; Scherpenzeel, A.
- Overcoming challenges to conducting online surveys; 2007; Ye, J.
- Opportunities and constraints of electronic research; 2007; Roberts, L. D.
- Nicht-reaktive datenerhebung: Teinahmeverhalten bei befragungen mit paradaten evaluieren. [Non reactive...; 2007; Kaczmirek, L., Neubarth, W.
- New technologies and tools for study management: Designing, implementing and maintaining a Web-based...; 2007; Courtney, L., Warmoth, E., Rodan, M., Katz, K., Subramanian, S., Kiely, M.
- Multiple imputation: review of theory, implementation and software; 2007; Harel, O., Zhou, X. H.
- More honest answers to surveys? A Study of data collection mode effects; 2007; Dennis, J. M., Li, R. J.
- Modes, trends, and content: A comparison of the 2003 HRS internet survey with HRS 2002 and 2004 Core...; 2007; Weir, D.
- Mixed-mode surveys with Netservey; 2007; Papagiannidis, S., Li, F.
- Lessons learned: Converting a telephone survey panel to an internet panel; 2007; Roe, D. J., Stockdale, J., Farrelly, M., Heinrich, T.
- Is Quanvert here to stay?; 2007; Read, N.
- ICC/ESOMAR International code on market and social research; 2007
- Global market research 2007; 2007
- Estimation of the effects of measurement characteristics on the quality of survey questions; 2007; Saris, W. E., Gallhofer, I.
- Equivalence of electronic and off-line measures; 2007; Roberts, L. D.
- Electronic data collection methods; 2007; Singh, M., Burgess, S.
- Dual-mode electronic survey lessons and experiences; 2007; Lang, M.
- Does mode matter for modeling political choice? Evidence from the 2005 British Election Study; 2007; Sanders, D., Clarke, H. D., Stewart, M. C., Whiteley, P.
- Developments in electronic survey design for establishment surveys; 2007; O'Neill, G.
- Design and development of an electronic survey system; 2007; Aaron, B., Desai, S.
- Counterfactuals and causal inference: Methods and principles for social research; 2007; Morgan, S. L., Winship, C.
- Can I use a panel? Panel conditioning and attrition bias in panel surveys; 2007; Das, M., Toepoel, V., van Soest, A.
- A guide to understanding Internet measurement alternatives; 2007
- Internet research ethics; 2007; Ess, C.
- Trust and privacy concern within social networking sites: A comparison of Facebook and MySpace ; 2007; Dwyer, R., Passerini , K., Hiltz, S. R.
- Knitting Patterns: for interview and analysis; 2007; Jenkins, S.
- Surveys and Technology – Polishing the Crystal Ball; 2007; Neffendorf, H.
- Choosing Web Surveys: mode choices among Youth Cohort Study respondents; 2007; Wardle, H., Robinson, C.
- Using Chat Tools to Perform Evaluation Interviews Eve-Marie Larsen; 2007; Larsen, E.-M.
- The Effect of Reminder Intervals on Response Rates for Web Surveys; 2007; Lemon, J. S.
- A new era of Market Research – Real-Time Sampling™ (RTS); 2007; Davis, H.
- Survey Research in a Wireless World; 2007; Pazurik, A., Cameron, M. R.
- Whither the Web: Web 2.0 and the Changing World of Web Surveys; 2007; Couper, M. P.
- Internet-based survey design for university web sites : a case study of a Thai university ; 2007; Vate-U-Lan, P.
- Visualizing Personal Networks: Working with Participant-aided Sociograms; 2007; Hogan, B., Carrasco, J. A., Wellman, B.
- Online research ethics; 2007; Madge, C.
- Response time measurement in the lab and on the Web: A comparison; 2007; Galesic, M., Reips, U.-D., Kaczmirek, L., Czienskowski, U., Liske, N., von Oertzen, T.
- Context effects in Internet Surveys: New issues and evidence; 2007; Smyth, J. D., Dillman, D. A., Christian, L. M.
- Technical considerations when implementing online research; 2007; Schmidt, W. C.
- Psychological Research on the Internet; 2007; Krantz, J. H.